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Abstract 

Educational outcomes across multiple countries show large gaps between children’s grade level curricular expectations 
and the actual learning levels of children. This paper discusses findings from an early grades literacy study and attempts 
to explore factors that potentially improve the English language learning results of Grades 3 and 4 learners in Bonsaaso, 
Ghana. The study was conducted in five schools, and the teachers were randomly selected into treatment and control 
groups. This is a quasi-randomized study. The objective of the study is to understand the components and processes that 
improve learning. The treatment included teacher training, constant feedback using real-time data and supervision, 
discussions of student-learning outcomes, materials development, corrective feedback to students and lesson plans. 
Overall, the percentage of the learners able to read as a result of this instructional treatment almost doubled compared to 
the control group; 34% of the students in the treatment group were classified as able to read at the end of the study 
compared to 18% in the control group. However, majority of the students were unable to read simple sentences. The 
classroom observations describe some of the classroom management and teaching techniques that could enhance learner 
performance. 

Keywords: real-time data, student learning outcomes, teacher feedback, teacher supervision, Ghana, primary schools, 
English education 

1. Introduction 

Since the implementation of the Millennium Development Goals—including that of universal access primary 
education—began in 2000, a hidden crisis in education has been uncovered: the problem of educational quality. The 
priorities in the international discourse have, accordingly, moved from enrollment to learning. This debate centers on 
the idea that there has been a lot of progress in improving enrollment rates, yet there has been very little emphasis on 
the learning levels of children who attend school regularly (Center for Universal Education at Brookings, 2011). Recent 
evidence on learning levels shows that this trend is visible in several countries (Beatty & Pritchett, 2012). To address 
this need, the UN Secretary General announced the Education First campaign, which targets access to education in 
conjunction with improving learning quality and fostering global citizenship. 

In East Africa, learning surveys have been undertaken that classified student ability to calculate and to read texts of 
various lengths (Uwezo Kenya, 2012 & Uwezo Uganda, 2011). Recent results suggest that in Kenya, 11 out of 100 
children in class 1 8 still cannot do simple class 2 division problems (Uwezo Kenya, 2012) 2 . Furthermore, 7 out of 100 
could not read a simple story in either English or Kiswahili. Uwezo tests results from Kenya showed that nationally 
only 3 out of 10 children in class 3 could read a second-grade text. In Uganda at least 9 out of every 10 (92%) of all 
third graders in P3 3 were unable to read a second-grade story in English. And of those third graders who could read a 

l ln Kenya, grades and standards are called class. 

2 Uwezo, meaning ‘capability’ in Kiswahili, is a four-year initiative that aims to improve competencies in literacy and 
numeracy among children aged 6-16 years old in Kenya, Tanzania and Uganda 

(http ://www.uwezo.net/). 

3 In Uganda, P3 or Primary 3 is equivalent to Grade 3 or Standard 3 in other countries. 
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second-grade story in English, about 10% failed to understand it. Results from UWEZO Tanzania (2011) were also 
discouraging. Only 3 out of 10 third 4 graders could read a basic story in Kiswahili and only 1 out of 10 Standard 3 
pupils could read a basic story in English. The results were no better in mathematics. Only 3 out of 10 students could 
add, subtract and multiply (UWEZO Tanzania, 2011). 

Such results are repeatedly seen in multiple countries. In the Gambia, Mozambique, and Nepal, more than 50% of the 
children are unable to read a single word of one-paragraph story after two years of schooling (Pritchett & Banerji, 2013). 
Data from the Southern and Eastern Africa Consortium for Monitoring Education Quality (SACMEQ) showed that less 
than 40% of the children attending Grade 6 have reached the reading proficiency levels required at that grade level in 
countries like Malawi, Zambia, Namibia, Mauritius, Zimbabwe and Kenya (Pritchett & Banerji, 2013). Simple tests 
similar to Uwezo were administered to children between 6 to 14 years old in rural India. Not only are children 
underperforming at grade level, but the overall learning levels also have decreased over the past years (ASER, 2011). 
ASER shows that 50% of the children in Standard 5 5 are even unable to read a Standard 2-level text (Chavan & Banerji, 
2012). This means that half of the children in grade 2 have failed to learn basic reading skills and may not acquire them 
in the following three years. 

This paper attempts to explore the factors that have the potential to improve English-language learning results of 
primary school children in Ghana. More specifically, it discusses the findings of a literacy assessment study conducted 
with students in Grades 3 and 4 in the Millennium Villages cluster in Bonsaaso, Ghana. The paper starts by explaining 
the rationale of the study followed by the Millennium Villages approach and context. This section is followed by a 
literature review on the supply-side factors that can potentially improve learning results. Next, the study design and 
implementation are discussed, followed by a description of the intervention package. The paper then presents an 
analysis of the study results and other observations. The paper concludes by discussing the challenges and successes of 
the study and ends by suggesting ways of scaling-up this approach based on the lessons learned through this exploratory 
study. 

2. Materials and Methods 

2.1 Geographic Context 

This study housed within The Millennium Villages Project (MVP), a project whose concerted effort is to show that the 
Millennium Development Goals can be attained in sub-Saharan Africa through targeted, multi-sectoral interventions. In 
the education sector, MVP collects monthly data from schools on key indicators. These indicators include literacy levels, 
student and teacher attendance and basic school infrastructure indicators. Data from Bonsaaso, Ghana have consistently 
shown low literacy levels. This study was, designed to understand the problem of low learning levels in the five schools 
located in the southern part of the cluster, and to evaluate the effects of a package of interventions addressing basic 
literacy of primary school students in Bonsaaso. It included administering literacy assessments and recording the 
learning results on mobile phones. It also included classroom observations and supervision visits by the Ghana 
Education Service (GES) staff and the MVP staff, and teacher training that involved demonstrating corrective feedback 
to students, classroom management techniques, creation of teaching and learning materials (TLM) and content delivery 
techniques. 

In addition to evaluating the effects of the remedial education interventions, an important component of this study was 
the use of mobile data capturing technology; it recorded real-time information, thereby supporting timely planning of 
appropriate interventions. A major part of the study was the creation of online Literacy Report Cards summarizing the 
results of the assessments. These were shared with schools, communities and officials from the Ghanaian Ministry of 
Education (MOE) within days of data collection. By processing and sharing test results in a timely manner, the study 
aimed to facilitate the implementation and evaluation of activities addressing learning gaps. 

Until 2002, Ghanaian language policy decreed that the lower primary grades would be taught in the local language, with 
English introduced progressively in the curriculum. By P3 (grade 3), students would spend the same amount of time 
learning English than the local language, and by the end of P3, they would be expected to be able to write simple 
sentences and read actual stories from textbooks, given the necessity of reading fluency for further learning. In 2002, 
however, the government changed the policy and mandated English-only instruction starting in PI (Owu-Ewie, 2006). 
As of 2009, the policy is to teach up to primary grade 3 in local language, and then fully transitioning to English by 
grade 4. However, English is taught as a subject since Grade l 6 . Therefore, this study assessed basic English literacy 


4 In Tanzania, Standard 3 is equivalent to Grade 3 in other countries. 

5 Grade is called Standard (Std.) in India. 

6 USAID and Ministry of Education Ghana Education Service National Education Assessment Unit (2014). Ghana 2013 
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skills of students enrolled in P3 and P4, in order to identify learning gaps that could be addressed through the design of 
effective remedial education activities. 

2.2 Background about the Millennium Villages Project Cluster in Bonsaaso 

Bonsaaso is located in the Amansie-West District of the Ashanti Region of Ghana. Nearly 70% of community members 
live on less than $1 a day. Just 4% of households have access to improved sanitation, and there is little access to health 
care, electricity, and communication services, as well. There are six villages in Bonsaaso with a population of about 
35,000 people residing in about 6500 households. There are currently 24 primary schools with nurseries, and four 
stand-alone nursery schools in small communities serving the school-going population in the Bonsaaso cluster. 

2.3 What Improves Learning Levels: Evidence from Existing Literature 

There is much research that defines how children leam new information and skills, particularly in low-income 
environments (Abadzi, 2007). The review below focuses on economically oriented studies that addressed “supply side” 
factors on teachers and pedagogy. The articles selected are either reviews themselves or are original articles based on 
evidence from developing countries. 

2.3.1 Teachers and Teacher Quality 

Efforts to improve teacher performance in low-income areas have been ambivalent. Few if any studies have found 
significant and positive impact of teacher training on student learning outcomes (Muralidhararan, 2012). Also few if any 
studies have found a correlation between teacher salaries and gains in student test scores. The impact of reduced 
pupil-to-teacher ratio on student outcome is mixed as well (Muralidharan, 2012). Mukerji and Walton (2010) shared 
results of a Kenya-based study (Duflo et al, 2006) where additional teachers were assigned to schools, while the control 
schools received no additional teacher. The groups of schools were randomly selected where grade 1 children were 
grouped by learning level based on a pre-test. In control schools, classroom groups were made without predetermined 
criteria. Mukerji and Walton (2010) show that merely reducing the class size by adding an extra teacher had no effect on 
the test scores of the students. Only when the school committee members monitored the teachers did teachers exert 
more effort. However, the learning gap between the contractual teachers and regular teachers did not substantially 
decrease. 

Another strategy has been to hire community-based local teachers. Hiring local teachers for a short-term basis to 
supplement regular formal teachers has shown to improve test scores both in Kenya and India (Duflo, Dupas, & Kremer, 
2011; Banerjee, S. Cole, E. Duflo, & Linden, 2007 as cited in Kremer, Brannen, & Glennerster, 2013). Monitoring 
teachers has also shown test score improvements. Research from India suggests that incentivizing teacher presence in 
class can improve test scores; one example was the use of cameras to monitor teacher presence in the classrooms (Duflo, 
Hanna, & Ryan, 2012 as cited in Kremer, Brannen, & Glennerster, 2013). 

2.3.2 Textbooks and Educational Materials 

Muralidhararan (2012) cites experimental evidence from Das et al. (2013) on the impact of a school grant program 
meant for purchase of inputs directly by students. The major input categories were books, stationery and writing 
materials, workbooks and practice books, and classroom materials. The results showed that there was a significantly 
positive impact on student test scores at the end of the first year; however the impact in the second year was close to 
zero, with the cumulative two-year effect being positive but non-significant. Perhaps households considerably reduced 
their own spending on their children's education in the second year of the program as a result of the additional funds 
made available by the school grant Muralidhararan (2012). Mukerji & Walton’s (2010) review shows that there is 
mixed evidence on the impact of instructional inputs such as reading materials and flipcharts on children’s learning 
outcomes. However, they note that when these materials were combined with appropriate teacher training and support 
there was a positive impact on basic math and reading skills for the children. Mukerji & Walton (2010) and Kremer, 
Brannen, and Glennerster (2013) note that in a study (Glewwe, Kremer & Moulin, 2009) where the provision of free 
textbooks to primary and middle schools in Kenya helped the scores of the best students; however there was no impact 
on the weaker students. The authors concluded that textbooks helped those students who already knew how to read 
fluently and not the ones that needed remedial help in basic reading. 

2.3.3 Pedagogy 

Several studies show the effect of teaching practices on learning levels. One example is an evaluation of Pratham’s (an 
Indian NGO) balsakhi program (Banerjee, Cole, Duflo, & Linden, 2007). Children in Grades 3 and 4 who had not 


Early Grade Reading Assessment and Early Grade Mathematics Assessment Report of Findings 
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acquired basic reading and numeracy skills were taken out of the regular classroom for two hours for a special 
instruction with a balsakhi , a contract teacher. The program modestly improved student test scores by 0.28 standard 
deviations, with most of the gains coming from students at the lower end of the learning distribution. 

Another study focused on communicating to the local village residents the status of learning among their children, and 
on the potential role that Village Education Councils (VECs) and local governments could play in improving learning 
(Banerjee, Banerji, Duflo, Glennerster, & Khemani, 2007). It was expected that awareness of literacy rates would 
motivate the community to improve them. Surveys conducted after an information campaign surprisingly showed that 
the campaign did not have any effects on learning levels. However, when the campaign was matched with community 
volunteers conducting classes outside schools in the same villages, the literacy levels of 6- to 14-year-olds in the 
community improved. In this case, information alone did not have any impact on the learning levels (Banerjee, Banerji, 
Duflo, Glennerster, & Khemani 2007). 

In contrast to the above studies which have taken only one or two elements, the Bonsaaso study combines different 
pedagogical and management elements such as teacher training, constant feedback and supervision, discussions of 
student-learning outcomes, materials development, and lesson plans to understand the literacy challenge in a rural 
district in Ghana. This study includes a package of essential inputs that are required to improve learning. The objective 
of this study was not to identify which component has the maximum impact on learning, however, the study helps to 
understand a holistic more systemic set factors are needed to improve learning. 

2.4 Study Design and Implementation Plan 

Our study included one P3 and P4 class from each of the five schools located in the southern part of the Bonsaaso 
cluster. One of the two classes in each school was selected for the treatment group while the other served as a control 
class. Since the schools were from the same region, it is most likely the school and the student characteristics are on 
average similar. The classes were not divided based on the learning levels. Therefore the class constitution should 
roughly be the same in terms of learning levels. Each of the participating schools had one P3 class and teacher, and one 
P4 class and teacher. Thus, a total of 10 teachers (and their corresponding students) participated in the study. In each 
school the treatment and control teachers were selected randomly by flipping a coin. The five schools were selected to 
participate in the study using convenience sampling, based on the following criteria: first, all schools in the sample 
offered a full cycle of primary education (P1-P6); had one teacher for each grade; and had reading textbooks available. 
Second, all schools in the sample were receiving the same support by MVP. Table 1 shows the enrollment and number 
of teachers for the participating schools. 

Table 1. Participating schools, student enrollment and number of teachers 


Study Participants 


Name 

Location (village 
name) 

Pupils 
Class 3 

Pupils 
Class 4 

Teachers 
class 3 

Teachers 
class 4 

Total 

Teachers 

1 

Bonsaaso D/A 

Bonsaaso 

46 

31 

1 

1 

2 

2 

Aboaboso D/A 

Aboaboso 

43 

37 

1 

1 

2 

3 

Akyekyerekrom 

D/A 

Akyekyerekrom 

33 

31 

1 

1 

2 

4 

5 

Apenimadi D/A 

Yawkasakrom 

D/A 

Apenimadi 

Yawkasakrom 

25 

17 

22 

14 

1 

1 

1 

1 

2 

2 




164 

135 

5 

5 

10 


All students enrolled in P3 and P4 in the five participating schools took part in the study. The same group of children 
was assessed in each testing round. Given the small sample size (5 schools and 10 teachers), we randomized teachers 
instead of schools to improve the likelihood of getting two groups with similar characteristics. That way, the number of 
randomized units was twice as big (10 teachers versus 5 schools). Teachers in the treatment group received training on 
effective techniques to teach reading. 

The study consisted of three main phases: (1) development and testing of tools and data management systems, (2) 
baseline and midline data collection and implementation of remediation, and (3) end line data collection and analysis. 

Since schools were selected using convenience sampling, the conclusions of the study are not representative of the 
entire population of schools in the Bonsaaso MVP site. Nevertheless, convenience sampling provides basic evidence 
and trends regarding the interventions being evaluated without the complications and costs of random sampling. The 
research team expected improved reading skills in the treatment schools at the end of the study as a result of the 
teacher-training package. Table 2 describes the data collection tools. 
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Table 2. Data collection tools, content and sample size. 


Tool 

Content 

Subjects and Sample Size 

Teacher Registration Form 

Basic characteristics of teachers 
participating in the study 

10 teachers (5 Grade 3 teachers + 5 Grade 4 
teachers) 

Reading Tests 

Reading tests in English 

301 students (Grades 3 and 4) 

Student Assessment Form 

Results of reading tests and basic 
characteristics of the student 

301 students (Grades 3 and 4) 

Classroom Observation form 

Checklist for supervisors to observe 
teachers, monitor implementation of key 
strategies 

5 ‘treatment’ teachers observed 


The Student Assessment Form took in the following information about the student: age, sex, school grade, and literacy 
level. It also scanned the bar code on the teacher’s ID card, which allowed researchers to easily categorize assessments 
by teacher. Finally, the student assessment form noted whether the teacher in question had participated in a training 
session since the last assessment, which aided in monitoring the treatment group. The classroom observation form 
included sections on classroom environment and materials, teaching techniques used, and teacher-student interactions. 
These classroom observation forms tracked classroom inputs, implementation of content taught in teacher training, and 
teacher feedback to and interaction with students. Teachers received feedback, and future training content was adjusted 
based on classroom observations. The form allowed all observers to have a standardized mechanism for tracking their 
observations and checking for classroom requirements, while still leaving room for additional notes and comments at 
the observer’s discretion. The Teacher Registration Form and the Student Assessment Form were programmed into 
Android phones for data collection using an open-source software program called Open Data Kit (opendatakit.org). 
Once the data was collected on the phones, they were directly sent to formhub.org, a data-management platform 
developed by the Sustainable Engineering Lab at Columbia University. From formhub, CSV files with the raw data 
could be downloaded for further processing. 

2.4.1 Test Design and Administration 

MVP monitors the reading and numeracy skills of primary school students using the tests and methodology developed 
by ASER in India and UWEZO in Africa 7 MVP has adapted and programmed these tests for their administration using 
Android phones. The reading tests were developed in collaboration with curriculum and assessment experts from the 
national Education Ministries and follow existing government standards and benchmarks set per grade. They are simple 
yet robust, structured to take no longer than 10 minutes per child. These tests are individually administered to each child. 
The reading tests assess children’s competency levels in four areas, including: letter recognition, words, paragraphs, and 
simple story comprehension. An UWEZO-style English literacy test was developed by Pratham for a Ghana MOE 
collaborative study (Ghana Teacher Community Assistant Initiative) 8 , and this test, along with others developed in 
collaboration with the Ghana MOE were used for this study. UWEZO/ASER’s testing framework is given in Appendix 
1, along with sample tests in Appendix 2. Children’s scores reflect their highest reading level: reading a story (usually a 
set of 5-6 lines that are connected), paragraph (3-4 lines which are connected), word (6-7 words which are combination 
of simple, medium and complex words), letters (around 9-10 combination of letters from easily recognizable to 
complex. Students need to identify any 5). If the child is not able to read at all, he/she is kept in the “nothing or needs 
improvement” group. For the purposes of this study, MVP categorized children in the ‘story’ and ‘paragraph’ categories 
as ‘children who can read’, and children in the ‘word,’ ‘letter’ and ‘nothing’ categories as ‘children who cannot read’ in 
grade 2. 

The learning assessment was conducted three times for this study: baseline, midline and endline. All children in both the 
control and treatment classes were tested at each interval. Independent enumerators, who were not involved in the 
intervention, tested children from the assigned study teachers (both from control and treatment). During the test, the 
enumerator sat on a desk and a chair outside the class. The teacher sent one child at a time to the enumerator for the 
10-minute-long assessment, so as not to disturb the whole class during testing. Enumerators carried one hard copy of 
each test to share with the child during the assessment. Test results, along with basic information about the child were 
captured on the phone using the Student Assessment Form. When conducting literacy assessments with students, the 
enumerator individually called up students, recorded the basic information, and pointed at items on the printed pages, 


7 In addition to working with Uwezo in East Africa, MVP partners with other NGOs and research institutions using the 
same approach. These institutions include Lartes in Senegal and OMAES in Mali. 

8 Please visit http://www.povertyactionlab.org/doc/ghana-conference-booklet for more details. 
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letting the child point if reading confidence was demonstrated. Each child had roughly five minutes to show ability to 
read the assessment material. Those who were able to read fluently to story level were positively acknowledged in front 
of the class. 

2.4.2 Development of an Online Interface to Track Results 

In collaboration with the Sustainable Engineering Lab 9 the project was able to develop an online interface to track and 
display the results. The data from formhub was processed into simple graphs that were displayed on the site: 
http://litreportcards.modilabs.org/about.html. The data was organized by treatment and control classes, disaggregated by 
grade level and displayed as “Literacy Report Cards” of the school. The interface is open to the public so that the results 
can be shared with a wider audience. All stakeholders, teachers, principals, MVP staff team and GES were able to 
review the data online within weeks of data collection. This helped the project to be more transparent and get more 
stakeholders to be involved. Since there was no internet access at the schools, printed copies of the Literacy Report 
Cards were distributed to school staff. This online interface was an efficient way of comparing the results between 
baseline, midline and end line, which helped to create a one-stop place that could display information in all stakeholder 
meetings, and any stakeholder interested in the study could visit the site and share as needed. 

2.4.3 Description of the Treatment 

The treatment involved working with selected teachers from primary 3 and 4 classrooms in the five selected schools, 
providing them with training on pedagogy and content, teaching and learning materials, sample lesson plans, and 
frequent monitoring and supervision. Throughout the treatment period, teachers were asked to adjust their subject 
teaching schedules to accommodate a 90-minute class period dedicated to English each day. Given the extremely poor 
results, all the stakeholders involved agreed that for the duration of this intervention, the formal curriculum would not 
be used, and supplementary materials, techniques, and activities would be implemented to catch students up to speed. 
Once they had reached the appropriate reading level for their grade, they would return to the formal curriculum. GES 
was willing to make changes in the regular school hours for this study. All the participating teachers and head teachers, 
acknowledging that literacy levels were very low and additional time focused on English literacy instruction was 
necessary, agreed upon this increased teaching time. The treatment group participated in training sessions devoted to 
explicit phonics instruction, using a guide developed by members of the Earth Institute education team. The training 
sessions were led by the Bonsaaso MVP education team, members of the Ghana Education Service (GES), and the 
Earth Institute education team. 

2.4.4 Teacher Training 

Three teacher-training sessions were conducted, along with an initial, orientation session. The orientation session was 
an opportunity to explain to participating teachers what the study was and why they were selected for it. Additionally, 
the orientation session demonstrated how the assessments worked and what types of activities and materials would be 
used in the future training sessions 

During the first session, GES, MVP, and the teachers discussed the results of the baseline survey results as well as the 
performance of students, most of who were reading only at a ‘letter’ level. Teachers were trained on phonics instruction, 
letter sounds, teaching sight words, and the five components of reading: phonological awareness, phonics, fluency, 
vocabulary and comprehension. Training also focused on learner-centered pedagogy and classroom management, 
emphasizing the importance of engaging students in the lesson activities, assessing their knowledge and providing them 
with feedback. 

The second teacher training session focused on lesson planning, scope and sequence, and differentiation. After GES, 
MVP, and Earth Institute teams observed teaching, it became apparent that teachers needed further support on 
narrowing their lesson focus and following a structured lesson plan, which would build from class to class. The session 
outlined the process for developing lesson plans and lesson objectives, including creating original TLM. The session 
also emphasized the concept of differentiation, a teaching process used to maximize student learning by improving the 
match between a student’s individual needs and skills and the curriculum. 

The final training was held as an informal troubleshooting session, in which the teachers and head teachers from the 
study wrote out a list of ten content-related and logistical challenges they were experiencing and members of GES and 
the education coordinator opened a discussion on each individual point. In the course of the meeting, concepts such as 
locally resourced materials, teaching sounds and letter names in logical sequence, and assessment procedures were 
reviewed. 


9 For more information, please visit http://sel.columbia.edu 
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2.4.5. Lesson Plans 

Ten sample English language lesson plans, prepared by literacy experts, were distributed to the treatment teachers in 
this study. Treatment teachers were encouraged to use the lesson plans in their classes, and to use the templates for 
future lessons. Using one lesson plan per day, the teachers were to spend at least 90 minutes covering its content. 
Lesson plans started at the most basic letter level, introducing 1-2 individual letters and sounds and reviewing 
previously taught content. It also incorporated the ‘I do, we do, you do’ method in which the teacher first demonstrated 
to the students, then worked with them, and then let them practice independently. With emphasis on phonological 
awareness, phonics, vocabulary and comprehension and writing, the lesson plans used sample dialogues to encourage 
the “I do, we do, you do” methodology. Suggested materials and reading to complement the lesson were part of the 
lesson plans’ content, and later lessons included fluency practice. 

After the initial distribution of these lesson plans, the MVP team found out that the teachers were unclear on how to use 
and incorporate them into their teaching. They were also unfamiliar with the presentation format. After further testing 
and review, the lesson plans were changed to a format more familiar to the teachers, placing ah the content in a grid-like 
layout similar to that of the lesson plan notebooks recommended by GES. 

2.4.6 Supplementary Teaching Materials Used 

Locally created learning materials such as phonics charts were developed with the guidance of GES personnel. During 
the training sessions, teachers were encouraged to keep students engaged with learning materials, encouraging them to 
practice reading, and interacting in new ways. 

Since textbooks were scarce or too complex for early readers to use, four one-page sample stories were also made 
available to teachers, each including two comprehension questions and a series of practice words from the text. After 
further discussion with some of the teachers, who asked for more content, six additional stories were developed, with 
more comprehension questions and vocabulary words. All the stories were bound together and distributed to schools 
where teachers who had participated in the first scale-up training were holding summer literacy classes. 

Lastly, creative learning games and interactive materials were demonstrated and supported. Teachers were shown how 
to create a foldable storybook from a single sheet of paper. They were encouraged to collect bottle caps within their 
communities and write a letter on each, and having sets for students to use to create their own words and identify 
individual letters and sounds. Teachers were also provided with flashcards to teach 220 sight words, a list of the most 
common irregularly spelled words that fluent readers should be able to recognize instantly. 

2.4.7 Instructional Supervision 

The MVP education coordinator led weekly visits to the schools, weather permitting, alongside affiliated members of 
GES, the monitoring and evaluation team, and other education team partners. About once a month, team members 
conducted unannounced classroom observations in each of the treatment classrooms. Information collected included: 
classroom environment and materials, teaching techniques, and teacher interaction with students, each with detailed 
questions. The observer positioned him/herself at the rear or side of a classroom during a 90-minute literacy lesson, and 
upon completing the observation form, approached the teacher to briefly discuss feedback in private. One such 
observation for each of the five schools was done in the final month of study. 

The role of the MVP education team was that of facilitator between teachers and students. In addition to leading 
meetings with teachers at their schools individually and in groups—including a final troubleshooting meeting at the 
MVP office—the education coordinator communicated with teachers via phone to enquire about progress. However, 
team members often intervened between the teachers and students at spontaneous intervals, often to clarify what the 
teacher was trying to say. 

To sum up, the treatment included the following package: first, teacher training to improve the pedagogical skills and 
knowledge of teaching in English. Second, sharing test results using the Literacy Report Cards printable at 
http://litreportcards.modilabs.org/about.html_showed children’s progress. Third, constant school supervision and 
corrective feedback by GES and MVP staff was a very important part of the study. Fourth, development of simple 
materials to support the teachers since the textbooks were way to complex to be used by early readers helped the 
teachers immensely. Fifth, providing lesson plans in the GES approved format that the teachers were used to helped 
with additional guidance on the types of activities that could be done in class to improve basic literacy. Finally, it was 
important to make teachers realize why children should reach the next stage in their literacy ladder. This progressed 
from nothing -> letter -> word-> paragraph -> story. And it formed the basis of the treatment. 
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3. Results and Discussions 






3.1 Background Characteristics of the Schools 

Table 3. Background descriptive of the schools 




School Names 

Indicator list 

Aboaboso 

D/A 

Akyerekyerekrom D/A 

Apenimadi 

D/A 

Bonsaaso D/A 

Yawkasakrom 

D/A 

TLM 






Number of textbooks to 

moderately 

moderately insufficient 

moderately 

moderately 

moderately 

meet student needs 
Notebooks and 

insufficient 

insufficient 

moderately 

insufficient 

insufficient 

insufficient 


pens/pencils to meet 
student needs 

Teachers have a teacher's 

sufficient 

sufficient 

sufficient 

sufficient 


guide for the core 
subject(s) they teach. 
Teachers 

no 

no 

no 

no 

no 

Teacher attendance 

90% 

95% 

85% 

97% 

91% 

Proportion of teacher 
Force trained on reading 
and/or numeracy 

instruction 

School infrastructure 

37% 

13% 

21% 

29% 

29% 

Are there sufficient 

desks/chairs to meet 

yes 

no 

no 

yes 

yes 

students needs: 

Is there any power at the 
school at the time of the 
visit: 

# school toilet 

no 

yes 

yes 

yes 

no 

compartments for use by 
anyone improved 

4 

2 

3 

2 

1 

# functional/improved 
toilet compartments 

1 

1 

1 

1 

1 

specific for girl: 

Primary source of water for 
drinking and hand-washing 

piped water to 
yard 

tube well 

tube well 

public tap 

tube well 

School meals are provided 
to pupils regularly 

yes 

yes 

yes 

yes 

yes 

School meal was provided 
to pupils during day of visit 
Student Attendance 

67% 

50% 

75% 

75% 

100% 

Proportion of enrolled 
male students attending 
class at the time of the visit 

93% 

81% 

89% 

88% 

91% 

Proportion of enrolled 
female students attending 
class at the time of the visit 

92% 

96% 

97% 

93% 

96% 

Student performance 
Proportion of grade 3 
primary school students 
who have acquired basic 
reading skills. 

Average reading level for 
all schools in the cluster 

20% 

12% 

8% 

13% 

35% 

24% 

27% 

20% 

15% 

9% 

Proportion of grade 3 
primary students who have 
acquired basic numeracy 
skills. 

94% 

68% 

77% 

86% 

93% 


Source: Millennium Villages month data collection system. The figures given are averages of the past 9 months. This 
data is collected on a monthly basis during the school’s academic year. 


The school background characteristics, as given in Table 3 above show basic indicators for student attendance and 
academic performance, school infrastructure, teaching, materials, and teachers. This data is collected on a monthly basis 
from the schools. The indicators also give a good sense of the similarities between the schools. Concerning TLM, four 
of the five schools do not have adequate pens, pencils and notebooks for all children, all the schools had a shortage of 
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textbooks, and none of the teachers have a teacher guidebook to help in teaching. All of the five schools do well in 
teacher attendance. School infrastructure indicators show that schools had at least one gender-separated toilet, three of 
the five schools had electricity most of the times, and two schools didn’t have the required desks and chairs for all 
children. Schools had running water and provided meals. Female student attendance on the day of the visit was above 
90% and upwards of 81% and for male students for all schools. Student performance data collected monthly on basic 
literacy and numeracy with 10 children picked randomly for P3 in the school shows that on average students do much 
better in numeracy skills than literacy skills 10 . The numeracy skills 11 ranges from 68% to 94%, however, the literacy 
rates (able to read a paragraph and a story level text at P2 level) were much lower and range from 8% to 35%. 

3.2 Summary of the Teacher Background 

Table 4. Age distribution of the teachers 

Ages _ Number of teachers _ 

23-25 3 

26-29 5 

30 and higher _2_ 

Total _10_ 

Table 5. Years of teaching experience 

Categories _ Years of teaching experience 

one-two years 3 

three-four years 3 

five to six years 1 

more than six years _3_ 

Total _10_ 

The ages of the ten teachers in this study ranged from 23 to 55 with majority of the teachers aged 26-29. All ten teachers 
only taught either P3 or P4.Four out of the ten teachers had a Diploma in Basic Education (DBE) and one teacher also 
had a Senior Secondary School Certificate 12 . Nine also reported having a different diploma in education. None had a 
master’s degree in education or higher degree. Only three teachers at baseline said that they had previously participated 
in any teacher training related to numeracy and literacy. 

3. 3 Study Results 

Students were classified as “can read” and “cannot read”. The “cannot read” group includes children who could only 
read isolated words, identify letters, or could not read anything at all. The students classified as being in the “can read” 
group includes those whose highest reading level was in the paragraph or story category of the test. For the purposes of 
this study, MVP categorized children in the ‘story’ and ‘paragraph’ categories as ‘children who can read’, and children 
in the ‘word,’ ‘letter’ and ‘nothing’ categories as ‘children who cannot read’ in grade 2. 


10 Note that MVP’s monthly outcome monitoring survey requires enumerators to randomly select 10 students from 
Primary 3 and administers the same literacy test that was used for the purposes of this survey. 

11 The numeracy skills include able to do addition and division. 


12 The options for teacher certification or qualification included- Certificate for pre-primary and nursery; Certificate "A"; 
Diploma in Basic Education (DBE); Senior Secondary School Certificate; Master and doctoral degree programs; In 
training for DBE; None of the above. More information on the teacher qualification scales for Ghana can be obtained 
from 

http://www.unilorin.edu.ng/joumals/education/ije/septl988/TEACHER%20EDUCATION%20AND%20THE%20ME 

W%20EDUCATIONAL%20SYSTEM%20IN%20GHANA.pdf 
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Figure 1. Overall literacy levels of children who cannot read (highest reading level: nothing, letter and words) for all 

children for the treatment and control groups 

Note: Children have been grouped under “Cannot Read” if they are in the nothing or letter or word category. These are 
children who are not fluent readers. 


Children who can read 



Control 

Treatment 


Figure 2. Overall literacy levels of ‘children who can read’ (highest reading level: paragraphs and story) for all children 

for the treatment and control groups 

Note: ‘Can read’ is a combination of percentage of children in the paragraphs and story categories. 

Figures 1 and 2 show percentages of children who can and cannot read from all the P3 and P4 children who have taken 
part in this study. The results show that in both treatment groups over the course of the study, the percentage of 
non-readers decreased and the percentage of readers increased. However, readers became more frequent in the treatment 
classes than in the control. Non-readers were reduced by 9% in the control group from baseline (91%) to endline (82%); 
by comparison, non-readers were reduced by 30% in the treatment group from baseline (96%) to end line (66%). At the 
end, 34% of students were classified as readers, compared to 18% for the control group. 

The results for each learning category by grade for the Control and Treatment groups are given below. 
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Table 6. Literacy results for all children by grade level for the Control and Treatment groups 




Control 



Treatment 



baseline 

midline 

end line 

baseline 

midline 

end line 

3rd grade 







Nothing 

4 

2 


9 

8 

3 

Fetters 

36 

44 

13 

25 

38 

28 

Words 

22 

2 

6 

10 

13 

14 

Paragraphs 

5 

2 

1 

1 

1 

8 

Story 

3 



1 


8 

All 

70 

50 

20 

46 

60 

61 

4rd grade 







Nothing 

4 

1 


3 

3 

1 

Fetters 

54 

57 

46 

51 

48 

12 

Words 

7 

8 

13 

15 

8 

10 

Paragraphs 

2 

2 

7 

2 

5 

6 

Story 

3 

1 

9 

1 

4 

13 

All 

70 

69 

75 

72 

68 

42 


Note: The results show numbers of children in each category. 
Figures 3 to 6 given below provide the literacy levels by each grade. 



Figure 3. Primary 3 Children who cannot read 

Note: ‘Cannot read’ is a combination of percentage of children in the nothing, letters and words categories. 



Figure 4. Primary 3 Children who can read 

Note: ‘Can read’ is a combination of percentage of children in the paragraphs and story categories. 
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Figure 5. Primary 4 Children who cannot read 

Note: ‘Cannot read’ is a combination of percentage of children in the nothing, letters and words categories. 


P4 Who Can Read 



P4 Control 
P4 Treatment 


Figure 6. Primary 4 Children who Can Read 

Source: Can read’ is a combination of percentage of children in the paragraphs and story categories 

The graphs show that, irrespective of the grades and group (control or treatment), the literacy levels were very poor at 
the start of the study but they improved by the end. For P3, the increase in the “can read” category for the control group 
was from 11% to 5%, therefore an increase of 6%. This increase was much steeper from 4% to 26%, which is a 
difference of 22%. For P4, the can read category showed an increase of 14% from 7% to 21% for the control group. The 
treatment group increased from 4% to 45% resulting in a net increase of 41%. In both grades, the net increase in the 
“can read” category was much higher for the treatment group. Nonetheless, not all children were able to progress to the 
“can read” group. At the end of the study, in both the treatment and control groups, there the majority of the children 
were still in the “cannot read” category. 

3.4 Discussion 

The results presented above show across grades that the treatment group outperforms the control groups in the “can read” 
group. There is also a much steeper reduction in the “cannot read” group in the treatment group as compared to the 
control group. It is important to note that at the end line survey, only 20 children in the P3 control group were tested, as 
compared to 60 children in the treatment group. These discrepancies in testing were due to student attendance. In 
addition, 75 P4 students in the control group were tested at end line as compared to 42 P4 students in the treatment 
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group. This large difference in the numbers of children tested may have affected the results. However, combining both 
P3 and P4 provides more robust results. Combining the total students in both treatment and control tested at end line, 95 
in the control group and 103 in the treatment group make a more even sample size. 

As mentioned previously, the end line data shows that 73% (146 out of the 198) children in both P3 and P4 irrespective 
of the group (control or treatment) are still in the “cannot read” category, which means that they were well below grade 
level. Only 26% (52 out of 198) of the children were able to progress to the “can read” category. All will most likely to 
be promoted to the next grades, P4 and P5, without mastering even P2-level basic language competencies. This 
automatic promotion, also called a “social promotion” policy, in Ghana allows students to proceed to the next grade 
without any requirements on the grade level competencies, which might explain why children have arrived at P3 and P4 
without basic reading capabilities. 

The study has been able to show modest improvements in basic literacy for P3 and P4, though there is much more work 
to be done. Students still need to develop more complex grade-level competencies. The study merely allowed some 
students to make up for the learning delays that had been accumulating for some time. These delays maybe because 
may because of the complexity of the language itself. Since English is not a transparent orthography, spelling becomes 
a challenge (Abadzi, 2007). It takes more than 2.5 years for mastering English reading with regular instruction time 
(Ziegler & Goswami, 2006). However in the Ghana setting, classes are irregular as well as attendance. 

3.5 Analysis of the Classroom Observations 

The classroom observations conducted during the study informed a large part of the training content. They helped the 
trainers identify teachers’ challenges and evaluate the effectiveness of content covered in the initial training sessions. 
The observations also gave insight into external factors contributing to student learning. A summary table of the 
classroom observations is given below. 

Table 7. Qualitative Field Notes Summary 


Main themes from the field notes _ 

Classroom Environment 

Minimalistic with no or very few educational materials on the walls 
Teachers used the blackboard for a lot of the teaching time 

Materials 

All children used their exercise books for writing from the blackboard 
Textbooks were not used as their level was higher than what the students could grasp 
Teaching techniques 

Emphasized going back to the basics of literacy, teaching letter identification, letter sounds, and basic words 
Teachers did not teach from the grade level curriculum 

Teachers were asked to make smaller groups of students based on their levels but this was not followed through 
Activity based teaching techniques were used often 

Teaching letters and sounds was implemented in all classes, however the way it was done varied from teacher 
to teacher 

Teaching nonsense words in the classes was not done systematically and often confused students 

Repetition and chorus reading still often dominated classes 

Teaching a word and then asking students to orally spell a rhyming word 

Teaching no more than three sight words in one lesson 

Dividing the chalkboard into portions 

Repeatedly distinguishing the phonics and letter name aspects 

Local language was often used as a tool for checking understanding 

More planning and structure was required in the teacher's approach to teaching literacy 

Teacher/Student Interaction 

Teachers gave individual feedback to the students during the lesson 

Soliciting help from another student when one got stuck on a word or sound was encouraged 
Participation from both boys and girls specifically 

Offering encouraging phrases such as “thank you” and “take your time” when students answered 
Gave the student enough time to finish speaking, asked for clarification, or checked back 
Using participatory games, such as “thumbs-up,” to teach phonics 

School Supervision and corrective feedback to teachers 

Teachers at the study schools displayed a keen interest in knowing the progress of their students 

Teachers and the observers sat through after the observation and discussed areas of improvements _ 

3.6 Classroom Environment and Materials 

Classroom setup was minimal, with rows of benches and desks facing the teacher and chalkboard at the front of the 
classroom. Few classrooms had legible or usable displays on the walls, and many students lacked materials to use in 
class. Teachers often wrote the entire story or lesson on the chalkboard, and students would come up with a pointer to 
read. Some teachers had prepared TLM, such as sight word cards or phonics charts, to use during lessons. However, the 
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display or handwriting of these cards was sometimes not clear enough for all students in the room to see. 

The treatment teachers were observed teaching some material from the prepared lesson plans, and while some teachers 
had prepared their own lessons, their lesson plan sometimes did not reflect what they taught.There were no textbooks; 
exercise books were rarely used, though this was consistent with the plan for treatment teachers to suspend teaching the 
official curriculum. 

3.7 Teaching Techniques 

Adherence to the training techniques and TLM varied among teachers, perhaps because the teachers needed more time 
to adjust to them. In teaching letters and sounds, teachers demonstrated a range of practices in describing the lesson 
objective, with one level 3 teacher using age-appropriate and understandable definitions repeatedly, and another level 3 
teacher simply writing “phonological awareness” on the chalkboard without further explanation. Another teacher was 
observed writing ‘vowels’ and ‘consonants’ on the chalkboard, but never defined these terms. 

Repetition and chorus reading still often dominated classes. Even when an individual student was called on for an 
answer, the same question was posed to multiple students after the first answer and then the class was asked to repeat 
the answer in unison. 

Nonetheless, teachers implemented several techniques. These included teaching a word and then asking students to 
orally spell a rhyming word, teaching no more than three sight words in one lesson, dividing the chalkboard into 
portions, and repeatedly distinguishing the phonics and letter name aspects. 

Twi, the local language, was often used as a tool for checking understanding. If a teacher’s question was met with 
silence, the teacher would translate to Twi until a response in English was offered. When learning letter sounds, English 
words written on the board as examples were intermixed with Twi words. 

One of the issues that came to light during classroom observations was scope and sequence of lessons. Lessons did not 
appear to be building on one another, and fluctuated between basic and more complex concepts within a single lesson. 
These issues were addressed during the second training, but teachers will likely benefit from additional support in 
improving scope and sequence. 

3.8 Teacher-student Interactions 

Several teachers used methods labeled as student-centered in training sessions. For example, when a poem was being 
taught in class, the teacher acted out the poem to make it more engaging; it also helped the children better understand 
the meaning of the text. Other examples teachers demonstrated included moving around the classroom to give 
individual feedback during the lesson, soliciting help from another student when one got stuck on a word or sound, 
asking for participation from both boys and girls specifically, and offering encouraging phrases such as “thank you” and 
“take your time” when students answered. When dealing with incorrect responses, teachers generally gave the student 
enough time to finish speaking, asked for clarification, or checked back with them after the correct answer was found 
elsewhere. Most teachers, however, limited student participation to whole-class interactions such as asking the yes/no 
question “Is he right?” Applause was the main way of delivering positive reinforcement to students. 

3.9 School Supervision and Corrective Feedback to Teachers 

Teachers at the study schools displayed a keen interest in knowing the progress of their students, particularly when 
monitoring and evaluation teams conducted individual assessments for baseline and end line data collection. Preceding 
all training activities, the M&E team held a short session to review student performance, though, at the final session, 
some teachers claimed they did not have access to their individual school’s performance report. 

Additionally, the teachers cited low literacy performance due to test anxiety induced by the use of unfamiliar materials, 
such as white paper, and by the presence of MVP and GES data collectors. To alleviate this anxiety, the education 
coordinators discussed methods for how teachers could put students at ease. 

In observations conducted in May, it became clear that some teachers themselves needed further reinforcement of 
correct letter sounds, so during instruction they did not focus on small, irrelevant pronunciation differences. Teachers 
also needed to be mindful of what was written on the board, and only write things that would help students understand 
the concept further and that they would be able to read. Another issue was the content of each lesson. Some teachers 
attempted to teach too many phonemes in one lesson, or to teach similar-sounding phonemes in the same lesson, which 
was confusing for students. 

In the weeks before the end line data was collected, classroom observations conflicted with school schedules or district 
assignments and were often irregularly conducted. At other meetings and trainings, teachers expressed a wish to receive 
more frequent feedback on their own performance. 
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4. Conclusion 

4.1 Lessons Learnt and Future Steps 

This study shows that while providing teachers with material and training to improve basic English-language reading 
skills is helpful, it is not enough. Increased pedagogical support, especially for lesson planning is essential. Additionally, 
improving teachers’ and students’ own command of spoken English is highly important, as Twi was still the main 
medium of instruction in an English class. 

Training sessions were most useful when they were adapted to teachers’ needs. This allowed teachers to incorporate 
specific techniques that they had not tried before, such as learner-centered teaching, positive reinforcement, and giving 
individual student feedback. 

Concerning teacher ownership of the study, involving GES and head teachers was crucial to getting teacher support and 
participation in this program. Furthermore, sharing the learning data with teachers built a strong case for following the 
study’s mission of focusing on basic skills and diverging from the formal curriculum. This break from the prescribed 
curriculum was necessary to identify children’s actual reading levels and how best to intervene to improve them. 
Making teaching relevant to children’s abilities and using data to monitor the progress repeatedly also constituted 
reinforcement for teachers. Focusing on supporting each child’s progression to the next level of reading helped teachers 
concentrate in their practice. Another helpful factor was that existing class time was used for the study, instead of extra 
classes or after-school remedial programs, which would have been onerous for teachers. 

5. The Way Forward 

Implementation of a program to improve literacy faces challenges both inside and outside the school community. 
Teachers in remote areas, many from different communities or balancing other forms of employment, are often unable 
or unwilling to invest time in preparing lessons and materials or enforcing basic classroom discipline. External 
challenges to schools in the Bonsaaso cluster include the ongoing extractive industry activity in the surrounding area, 
which affects regular student attendance. Weak parent-teacher relationships often contributed to a lack of home support 
for education, which teachers frequently attributed to fluctuations in students’ performance or attendance. 

The study team and teachers both identified a need to build capacity in learning and literacy methodologies. Thus, the 
treatment teachers consistently said that the sessions that focused on pedagogy were among the most useful, along with 
the sessions on TLM preparation and use. 

Steps to scale-up are to begin in late 2014. The scale-up will rely on analysis of the successful and unsuccessful parts of 
the study, and will involve training the control teachers in techniques that were found to be effective. Data will be 
collected for all teachers and will be compared with results from the original treatment teachers. 

While the impetus for the study was to improve students’ English-language skills, the data suggest that native language 
mastery and literacy depend on it. The authors therefore suggest using Twi as the primary language of instruction for 
early grades and supporting children’s reading skills in Twi, especially because native language literacy skills support 
second language literacy skills. This will involve focusing on fluency in Twi before reading fluency in English. 
Concurrently, oral English could be taught while learning to read in Twi. Therefore the language acquisition skills for 
the local language can help with English and the children will become literate in Grade 1. 
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Appendix 

Appendix 1: Steps to do the Assessment 


PARAGRAPH 


Ask the child to read the paragraph. Listen carefully when the child reads. The child may read slowly, but as long as s/he is reading the text like s/he is 
reading a sentence rather than a string of words, categorize her/him as a “para level” child. 


_ \ _ 

If a child is reading very slowly anu aups between words for a long time, 



if s/he is reading the text like it is one word after another and therefore 
not reading the text like she is reading a sentence, then she is not a 
“para level” child You should take the child one level lower and ask 
her/him to read words. 


i 



Source: UWEZO 


! 

Once you have aecided that this child is a “para” level child, ask the child 
to read the story. 


STORY 


• If the child reads the story fluently, with ease and speed, mark her/ 
him as a “story” level child (or a child who can read a Standard 2 
level text). 

• If the child is unable to read the story fluently and stops a lot, mark 
the child as a “para” child. 
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Appendix 2. Sample test in English 

Story Paragraphs 


Salma is a little girl. 


Slie had a little doll. 

Dasana goes to school. 


It is very far away. 

Site loved playing with the doll. 

He takes a bus to school. The bus takes 

One day the doll fell from her hand, to the 

four hours. 

floor. 


It broke Into several pieces. 


Salma was very sad. 

Akosua has a red flower in her hand. 

She cried a lot. 

The flower is very pretty. 

Her mother gave her another doll. 

It likes the sun. 

She became happy again. 

It smells nice, too. 


Figure A. side one of a literacy test 


Letter Recognition 


Word Recognition 


P 


t 


s f 


Girl 

Farm 

Drum 


Fame 


k 


a 


Boat 


Foot 


n Z 

d 


1 


Hand 


Feck 


Pick 


Soap 


Figure B. side two of a literacy test 
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